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(54) Method and apparatus for simultaneously displaying graphics and video data on a computer 
display 



(57) A method and apparatus for displaying graph- 
ics Oita and video data, such as a video window, on a 
computer display. A graphics adapter chip stores graph- 
ics pixel data in a graphics memory, and a video source 
sioms, v rtno pixel data in a video memory The graphics 
and video memories sequentially output blocks of pixel 
datn :o nc display screen on output channels. Graphics 
data is selectively outputted on a number of graphics 
channels and video data is selectively outputted on the 
same number of video channels. The video channels 
arc multiplexed with the graphics channels to form the 
output channels and either graphics data or video data 
can be output to the display on each output channel. A 
number of dummy video pixel values can be inserted 
bcioic tidco data in the video memory to align video 
pixels between blocks of graphics data on the display 
screen m one embodiment, a source selection element 
selects qraohics and video channels by reading a win- 
dow -:ypc memory to determine which pixels on the 
screen arc 7 intended to display graphics data and which 
pixels are intended to display video data. The data on 
the output channels is converted to a form suitable for 
driving the display screen of the computer system. 
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« G raphical applications are becom.no incrJsra^,^* 9 P V ' de ° S ° UfCeS 00 lhe same 

and other v.sual and graphical eTeTdisplavS^ JT , H ' 9h feSO,U,IOn pic,Ufes ' action, 

coprocessors are deve£« hav"g gSe, ToZ an^ZL" 7™ h3Ve beco ™ commonplace as computer mi- 
ample, are used widely. It is genS^ccSS ST ^ . GfaPhiCa ' USe ' in,ertaces (GU, ' S >' '° r «■ 
use, and that « is quicker to S^aSK^2^^- fl ' W ^ ' n,erf3CeS (GUI ' S) 3re <° 

» The increased graphical capable* of ™ 2 T , env,ronment ,han in a "«*3UI environment. 

screens A v.eo J^eT^ClZo^^^ tttZZP* °" *^ 
computer. Components such as an analwtOHlioitaicLJ^r/Ti^r ^ Sed ,0 ,nput a v,deo s '9" al *> a 
whK* the computer can process™^ 

picture elements of an image on a *£, sSSn flTcJES? * are fundamental 

* anatog converter (DAC) to display aSS ^^^^2? T* ^ **> t0 a di 9 ital to 
-mages and an.mat.ons of a CRT of Ttefev.siS or ^lT^ **** temn took like ,he dis P'av«l 
color and reso.ut.on wrth no loss inlme raZ de^ P M " V C ° mPU,erS *" ' We VK3eo «■"* in fu.l 

A common application of computer-displayed video signals is to disolav a video 
by displayed computer-generated graphics For exarrole inVr. l °" a screen su "™ded 

ground, several menu selections k£ shSe ,h OTPU,8f tyPiCa " y d ' Spl3yS a 9 raphical ba ck- 

on one porton of the screen J^^'^^f^l^rj * U T 30 bediSP * yed 

thus watch a live video window while JZkiZ wTh!f,L ^ 9raph,cal objec,s A CW W user could 

a spreadsheet window Se ^d^ SUCh aS 3 p — sing w.dow or 

—a^ 

-mplemented as an appleation specif atS cireurt SSS "JET^ Ch ' P K WhiCh Can be 

such as drawing commands rendehnn ( ' raph,CS adap'e'chip 14 receives the commands 

on a display screen 9 A conwwin^ f^^^^'^aphKSdatato analog data to be displayed 

the OAC to a color display " £2? TS* 9r * en ' 3nd b,Ue (RGB > from 

ground 22. 21 ' S Sh0Wn ******* 00 ^reen 19 with a graphics back- 

source is input to an analog-to-digiteTc^^ anato9 video si 9" a l Tom the video 

^ita. s.gna. suable for use with «heThe"di^ 

synchronization signals from the digitized video date ThH^2^!/!r USable video 0)3,3 and 

n.zation signals and other data derivi frarn^™^ ^ 8Codef/Scal » r 24 outputs digital video data, synchro- 
mixed wimVus 15 oSTil £££ StSKV? Tl' 0 ^ Skilled ,he art °" bus 26 ' * 
memory wrth graph^ ZSy gtSXer ^ ^ J TS'" ^ 16 ^ ,hUS Sh3fes ,he 
of memory and is readily accessible byZ ^Z^ZZ rlt ^^^^ is ^ in a particular section 
rrom^emicroprocesJindi^wheS^^ 

data to be output from VRAM 1 6 when appropria* ^ C3USeS 9r3pnics da,a or video 

"en^a^ai^ 

Cisp^y system is ^iSSS^c?^ 7 S? T T' ^ «*' H ° Wever ' ,his 

bus. the amount of graphics and video data tha cT^Sl IZ JT™ * ^ V,deo dBla share the sa ^ 
subs,an, B „ reduced, e'spec^.^ ^S^^SS^^ 3S5 - . ,B T 18 ^ ^ iS 
width. The performance of the display system ^^c^ ^ TjZ ^l^ * b3nd " 
small size or a low resolution so that the fu.l frame rate of ,hf^ , ^ WindOW iS lim,,ed 10 a 

video signal is reduced so that a papula ZZZtl Z *2£ ^ ^ b9 diSpl3yed - or ,he ,ra ™ ra .e of the 
of a video signal ,n the video ^*ttogr£T 66 dlSP ' ayed ' n ei,her Case ' the Plantation 

What is needed is a disp^y system of a computer system that provides a fcrge memory bandwidth capable of 
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displaying a large video window at a high resolution and full frame rate while displaying graphics on the other portions 
of the display screen The video window should be displayed without any video image clipping and without any restric- 
tions as to its displayed location on a computer screen. 

In accordance with an aspect of the invention, there is provided a method for simultaneously displaying graphics 

5 data and video data on a display screen of a computer system having graphics memory and video memory arranged 
to store image information to be displayed on the display screen, the display screen displaying a multiplicity of pixels, 
wherein the graphics memory and the video memory are each arranged to sequentially transmit blocks of pixel data 
to the display screen on output channels, and wherein each block of pixel data includes data for a plurality of screen 
pixels that is transmitted simultaneously, the method comprising the steps of: storing graphics data received from a 

10 graphics source in graphics memory; storing video data received from a video source in video memory; selectively 
outputting graphics data for a block of pixels simultaneously from the graphics memory on a number of graphics chan- 
nels when only graphics data is to be transmitted to the screen on output channels connected to said graphics channels; 
selectively outputting video data for a block of pixels simultaneously from the video memory on a number of video 
channels corresponding to said number of graphics channels when only video data is to be transmitted to the screen 

is on said output channels, wherein said video channels are coupled to said graphics channels to form said output chan- 
nels and wherein either graphics data or video data is output to a display screen on each output channel: and when 
both graphics data and video data are to be transmitted to the screen simultaneously in a single block of data on said 
output channels, selectively causing the output channels that are intended carry graphics data to transmit only graphics 
data and selectively causing the output channels that are intended to carry video data to transmit only video data. 

20 in accordance with another aspect of the invention, there is provided an apparatus for displaying a video window 

on a display screen of a computer system, comprising: a graphics memory having a set of output graphics channels 
suitable for simultaneously transmitting graphics data for a plurality of screen pixels; a video memory having a set of 
output video channels suitable for simultaneously transmitting video data for a plurality of screen pixels, wherein each 
video channel is coupled to a corresponding graphics channel to form a pair of channels and wherein an output channel 

25 is coupled to each of said pairs of graphics channels and video channels; a selection element for selectively causing 
data from said graphics memory and said video memory to pass on each of said output channels such that the output 
channels may transmit a block of pixel data that simultaneously includes both graphics data and video data divided on 
a discrete pixel basis; and a converter element for converting data on said output channels into a form suitable for 
driving the display screen of the computer system. 

30 in accordance with a further aspect of the invention there is provided a computer system comprising: a processor; 

a memory element coupled to said processor; a graphics adapter coupled to said processor for receiving commands 
from said processor and outputting graphics data according to the commands; a graphics memory coupled to said 
graphics adapter for storing said graphics data and having a set of output graphics channels suitable for simultaneously 
transmitting said graphics data for a plurality of screen pixels; a video converter for converting a video signal from a 

35 video source to video data suitable for storage in video memory; a video memory coupled to said video converter for 
storing said video data and having a set of output video channels suitable for simultaneously transmitting video data 
for a plurality of screen pixels, wherein each video channel is coupled to a corresponding graphics channel to form a 
pair of channels and wherein an output channel is coupled to each of said pairs of graphics channels and video chan- 
nels; a selection element for selectively causing data from said graphics channels and said video channels to pass on 

to each of said output channels such that the output channels may transmit a block of pixel data that simultaneously 
includes both graphics data and video data divided on a discrete pixel basis; and a converter element for converting 
data on said output channels into a form suitable for displaying said data; and a display screen coupled to said converter 
element operative to display said converted data. 

An embodiment of the invention provides for simultaneously displaying graphics data and video data on a display 

45 screen of a computer. Separate graphics and video memories are used such that memory bandwidth and data transfer 
rates are higher, leading to larger displayed video window sizes and more realistic video presentation. The present 
invention uses dummy video pixel insertion in one embodiment to prevent losing video pixels and/or restricting the 
placement of the video window on the computer screen. 

A method is disclosed for simultaneously displaying graphics data and video data on a display screen of a computer 

so system. "Yhe computer system includes graphics memory and video memory arranged to store image information to 
be displayed on the display screen. The graphics memory and the video memory each sequentially transmit blocks of 
data to the display screen on output channels, and each block of data includes data for multiple screen pixels that are 
transmitted simultaneously. The method includes steps ot*stonng graphics data received from a grapnics source in 
graphics memory and storing video data received from a video source in video memory. When only graphics data is 

55 to be presented on the screen in a block of screen pixels, a block of graphics data is transmitted to the screen over a 
number of graphics channels. When only video data is to be presented on the screen, a block of video data is output 
from the video memory on a number of video channels corresponding to the number of graphics channels The video 
channels are coupled to the graphics channels to form output channels, and either graphics data or video data can be 
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graphics data are setectnrely caused ,o transnTon" ^Z^ uSZ TTlT *? '"'^ Carry 
lo carry video data are selectively caused to transmit ^V^^f a , J ' Pl " Channe,s ,hal are 

* row of output date in a shift register before 5^«^££ 2 ,° h ? ,he Vide0 memof V st0 ™ » 

before the data is output In one embodiment tn a 1 * ^ ° the ° U,pUt data is snif,ecl into an output buffer 
o. dummy video pixe.'valo^ Si £ K^JST °' ^ **■ 3 

dummy pixe. values is based on the positive ^ * Vide ° memofy The ™ mt »< of 
seiection of graphics and video chanrols™^ 

- screen are tntended to disptay ^^^^ ^ P«e.s on the 

An apparatus tor dispiayina a video wind™ ™ * h . intended to display video data 

^ingasetotc^g^ 

pixels The apparatus also includes a video m «Z *" 1ultaneous| y "fronting graph.cs data for a plurality of screen 
,ansm,„ing vtfeo data i " ^ SSSSTE! Soo'STnl^ '"T' 8 ^ usfy 
channel to form a pair of channels!* an ouTpu, chLeT« c^TIh '° 8 corfe ^^9 graphics 

v*«ocr«nne.s.Ase.ect,oneler^^ 

to pass on each of me output channels. The output cnannet mTtran^TAT», ,CS , Channe,SOrthe 
■nciudes bom graphics data and video data divide? on SZeSS W ° Ck * P "*' *« s'™"aneously 
data on the output channels into a form surtabte tor^^ n?. 1 ^ e,emem is u *<* for converting 

■men, lhe selection etement inches 3ottvle meZ! h ' " ^ °' ^P"* 6 ' SyS,em ln OTe 
«. the computer screen In me rj^lTT^ 9 9 m9m0,y map °' me of a video window 

^o.hev^ta.nmev^ 

on vdeo channels that are not selected to outpm daTj the ^ video <>™* «d are output 
«w*,y ; ,nd actual video data is not lost A fra^orZ!^ ^ P °* P ixel * are thus thrown 

source cement for controlling me ^ tZ T ^ ^ ,0 ,he Vide0 ™™V - *• 

proson, <nven tl on, a digital to analog cc^oWSn SflZL?, T° T 0 * ,n 30 alterna,e of the 

V1 doo puets stored in a queue '° ^ 9faphlC8 ^ * output graphics and 

■o-d.^^ 

W,m .n creased data transfer rate. TJ^TZ^^ZnTL™ ^ 3 ^ bandwio1h * ^ 

AP<e<orredembod™n.ofmepreseS 
w-thcu, navng any pari of the vidj im^ge ^^£^^^' M !^^^^ ad ^y^ 
Th,s .cure a.so allows the vxteo windo *ooe iv 9faphiCS piXelS vrieo P™* 

These and other advantages of t»w£^£^JE ***** b ° Unda,y disp,a ^ °" ,he screen, 
'^tow^escripti^ 

ny^r^r^^^^ 
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FIGURE i is a block diagram of a prior art computer display system; 
,n?cn^ 

shownln ^rar^ ***** a " d ^ in the dsptay system 

2^11^^ ,,,US,ra " 19 8 """«""' * 8 "* ^ics channe, and video channe. as 

FIGURE 4 is a block diagram of the dummy pixel logic of the present invention; and 

FIGURE 5 is a bfcck digram of an aftemate embody, o, a computer dfspfcy system of me present invention 
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Figure 2 is a block diagram of a first embodiment of a computer display system 30 that incorporates the present 
invention to display a video window on a display screen. Display system 30 includes a microprocessor 31 , a system 
bus 32. a graphics adapter chip 34. graphics memory 36. window-type memory 38. a video source 40 analog-to-digital 
converters (ADC's) 42. a decoder/sealer 44. a video memory 46. source selection logic 48. digital-to-analog converter 
5 (DAC) 50, frame-grabber controller 52. and a display screen 54. While buses of specified width (i.e., 8-bit buses. 32 -bit 
buses, etc.) are described below as an example, it should be appreciated that a variety of different types of buses 
having different numbers of lines can be used in different embodiments. 

Microprocessor 31 is the mam processor of the computer system and is coupled to system bus 32 for data transfer 
to components and peripherals of the system, including display system 30. System bus 32 is atso coupled to RAM, 
'0 ROM, input/output ports, and other components generally used in a computer system (not shown). System bus 32 can 
be used to send data signals, address signals, and control signals. 

Graphics adapter chip 34 receives data over system bus 32 and creates graphics pixel data to be displayed on a 
display screen. Commands from the microprocessor of the computer system are input to the graphics adapter chip on 
the system bus and instruct the chip to draw graphical objects, mathematically render images, etc., and to create pixel 
J 5 data to be displayed on the display screen. A suitable graphics adapter chip for use in the described embodiment is a 
Sun GX or TGX application specific integrated circuit (ASIC), manufactured by Sun Microsystems, Inc. of Mountain 
View, California. This ASIC includes a graphics rendering engine, a memory controller, and a CRT/display controller 
on a single chip. Separate chips having these functions can be used as well. Graphics adapter chip 34 outputs graphical 
data on bus 55, which in the described embodiment is a 64 bit bus. Bus 55 is divided into two 32-bit wide buses which 
20 input data to graphics memory 36. The graphics data is preferably formatted into a number of pixels, wherein a pixel 
is the smallest displayed picture element on the display screen. Taken collectively, the pixels form an image. Pixels 
are generally positioned in rows and columns on the screen. Each pixel is represented by a number of bits, and the 
numerical value of the bits indicates a pixel's attributes, such as the color or shade of the pixel. 

The graphics adapter chip controls the display of graphics pixels by continuously outputting stored pixels from 
2S graphics memory to DAC 50. Graphics adapter chip 34 also receives information from the microprocessor indicating 
where a video window is to be displayed on the display screen. This information is input to window-type memory 38 
(described below). 

Graphics memory 36 receives graphics data from graphics adapter chip 34 and stores the data until it is output 
and displayed on the screen. In the described embodiment, two banks of memory 58 and 60 are used to store the 

30 graphics data, where the first four of any eight horizontally contiguous pixels are stored in one bank 58. and the second 
four pixels are stored in the second bank 60. Graphics pixels stored in graphics memory banks 58 and 60 have eight 
bits apiece in the described embodiment, which are used to store information about the color of the displayed pixel. In 
the described embodiment, each bank 58 and 60 is a 128K x 8 VRAM chip. In alternate embodiments, other types of 
memory can be used as well, including dynamic random access memory (DRAM). Also, in alternate embodiments, the 

35 graphics pixels can have greater or fewer than 8 bits per pixel, such as 16-bit or 24-bit pixels. If a pixel includes more 
than 8 bits, a larger graphics memory than the described memory would typically be required to store the pixels, and 
a greater width of the datapath between graphics memory and DAC 50 would be needed. In addition, a DAC 50 sup- 
porting the larger pixels and multiplexing would be needed. 

Graphics memory 36 outputs data on 32-bit bus 62 in the described embodiment. The outputting of graphics pixels 
is controlled by graphics adapter chip 34 using address and control lines (not shown). The graphics adapter chip 
continuously outputs graphics pixels at a rate consistent with the display screen's refresh rate. In the described em- 
bodiment, the data on bus 62 is divided into 4 pixels of 8 bits per pixel, for a total of 32 bits. Each 8 bits of bus 62 is 
considered a "graphics channel" that carries information about 1 pixel at a time; bus 62 therefore includes four graphics 
channels in the described embodiment. The four graphics channels transmit four pixels simultaneously from the graph - 

45 ics memory; herein, these four pixels are considered a "block" of graphics data. "N" graphics channels can be used in 
alternate embodiments, where "N" can be a value of 2 or greater. 

Each bank 58 and 60 of graphics memory 36 includes an output buffer which outputs a single 32-bit block of four 
pixels at a lime. When using a VRAM or similar type of memory, shift registers in graphics memory 36 can be used to 
provide pixels fronrUhe memory storage locations to the output buffer, as described below with reference to video 

so memory 46. Banks 58 and 60 also include tn-state buffers for each output bit. These tri-state buffers can be enabled 
or disabled to selectively output bits at specific locations in the output buffer. Source selection logic 48 can control the 
tri-state buffers to select which graphics channels are enabled to output graphics pixels (described below). The graphics 
channels are multiplexed with video channels from a video memory and sent to a DAC to be output to the display 
screen, as described below. 

55 Window-type memory 38 is coupled to graphics adapter chip 34 via bus 55 . In the described embodiment, window- 

type memory 38 receives the lower 4 bits ol bytes output by graphics adapter chip 34 on a bus 63; since graphics 
adapter chip 34 preferably outputs 8 bytes, window-type memory 38 receives 32 bits. The microprocessor 31 writes 
data into window-type memory 38 through the graphics adapter chip 34 indicating the pixel layout of the display screen, 
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stores Ltltr^ 7 69n 9faPhiCS PiX6,S and "** h pixels are VKS °° ™* window-^pe memory 
stores Ihe screen layout as pixel codes indicating a pixel-by-pixel description ot the display screen For ™T^I 

5£^^nSL2 bB , ^ a,ed by a certa,n p,xel code ■ Bd 9raphics pixe,s can ba 

hLTnXL^ h ? fescnbed embedment, window-type memory 38 is four bits deep; thus a y,deo pixel can 
betweln 0 Inn T* "** " ' *' 8 PiX9 ' " be indic3,ed b V a I*- "d. between 0 and 4 T Se c^e S 

SSTSlSfJlT 1 C °" tain ° ,her 133,3 re,3,ed to *• *P* screen layout. For exalte, data related tocoSo 
pixels for each specrfic application program that is running on the computer system can be stored such *fL£ nZnl 

codes of onty 1 bit per p.xe. are actually required to store pixels as either yideo or graphic* pixels in 

a 1 K 3,a c * nd0 "- ,yp3 memo, y 38 is 3ccess< * "V 'he source selection togic 48 through bus 61 which is preferably 
a 16-b.t bus. Four 4-brt pixel codes (one pixel for each channel) is suppliedio the source selec toSL ™ h,T« 

when the OAC 50 reads a ya.ua of 15 on bus 61 from the window-type memory data, it expects a ^i^Sei 
(from video memory), and when the DAC reads a value between 0-1 4 on bus 61 it exoects Jbm n,«J «!1 * 
memory,. ,n me described embodiment, wmdow-type memory is the 

Video source 40 is used to input a video signal into the display system 10. Video source 40 can be a television 

the dTnLv eom , T** 'T 9 " me anal09 input video 8i 9 nal t0 3 di 9» 3 ' «9na. which can be manipulated by' 

a TDA8709 for S-vrieo. both manufactured by Philips/Signetics, are used as ADC's 42 In Ln^m^SS^l 
video source can prov.de a digital video signal directly so that no ADC 42 is required embodiments, a 

3 ^ Si9 " al ° nbUSeS 64 the d8SCribed e "*«^ent, busses 64 are 8-bit buses that 
send a dgrtal s.gnal represent^ the analog video input signal. Two buses 64 are provided in the described emboJ 

£Z t TTTT** *** inpUt Si9na ' ,0 3 24 * tt ^reen-b.ue (RGB) output signal. A coJSy useSe 

is aescriDed by 8 brts. 24-brt pixel format is considered true color*, since a much larger and realistic ranee of color* 
can be delayed man only 8 bits were used. Other N-bit pixel formats can also be used i aZate emb^ mlms 
for example, ,6-brt or 15-bi, RGB pixels and 16-bft YUV pbcefs are common formats. tSSSISS^I 

nance agnate in the RGB format. The scaler of decoder/sealer 44 also scales the inpul digital data from a standard 

F^«r;iT e ^^ 

21 Lti^Z 8 , ""FT"*" 52 00 SyS,6m bUS 32 The ,rame 9 rabb8r C0 <«'°" 3 ' then send^ ESESS 

° ' T ^ i 80- " 44 adJUS,S th9 reSO,Uti0n °' 919 vidao 3nd outputs vSeo 2 

hat correspond to the new v.deo wndow size, as is well known to those skilled in the art. In the described embodiment 
me scaler scales the video wrdow from a standard resolution ot 640 x 480 pixels to the J^SITZS, 
scaler can i be .mplemented using model SAA7196 manufactured by PhillipJsignetics In the hJSboSS? 
24-b.l RGB video data is output from decoder/sealer 44 on bus 66 described embodiment. 

Video memory 46 is coupled to bus 66 output from decoder/sealer 44. In me described embodiment bus 66 is 
routed into four buses of 24 bits each, where each bus is *pu, ,n,o a different bank of vdeo merr^^Banks A D 

i a T TOrPe,a,9d " 3 SeqU9n,ial aCC6SS me ™V of *° -e-ory (all (our^kTarTshown as 
one b« « Figure 2). The data at each bank of the video memory is docked in sequential* ar* Us sto^Ttne 
same order n the memory (the data is preferably clocked into shift registers within the^eo memory and me^s.o 2 

rnus^the decoder/sealer 44 sends out a 24-bit prxe. which is ctoc^moBaniiK^^^^t^^ 
^ ° n ^ 0U,PUt bV decoder/sc3l3r 44 - ckxked into several ££££££ 

^lerence to Figures 3a. 3b, and 4. The video memory of the described embodiment is 1024 x 512 x 24 so that the 
n^mum-s.zed vxJeo window having 24-bit pixels stored in the video memory is 1024 x 512 pixels nail ! 
bodiments, difleren.^sized video windows or v,deo memories can be used; for examp,e. two EL slSS x 24 
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storage areas of the video memory can be used to reduce the "video tearing' effect, which occurs when computer 
monitor refresh rates differ widely from video source refresh rates The two identical storage areas in memory can be 
used as two buffers of video memory in which video pixels are stored. The two buffers can alternately output a complete 
frame of video data as the buffers are filled so that no partial frames are displayed on the screen. 

5 Video memory 46 of the described embodiment includes a second sequential {or serial) access memory port used 

for outputting video pixels from the video memory. The output channels are organized into three buses of 32 bits each, 
where each group of 32 bits is used for one primary color of red, green, or blue. Since 8 bits represents each primary 
color in 24-bit video signals, each of the 32-bit buses includes four video channels of eight bits each. Each 32-bit bus 
thus can send one color component (R, G, or B) of four video pixels, one video pixel on each video channel. As described 

w below, DAC 50 receives 24-bit video pixels separated into the three RGB 8-bit portions. Bus 74 thus carries the 8-bit 
red components of 4 video pixels, bus 70 carries the 8-bit green components of 4 video pixels, and bus 72 carries the 
8-bit blue components of 4 video pixels. As referenced herein, a 'block' of video pixels refers to the 4 video pixels 
output on buses 74, 70 t and 72. 

In the described embodiment, buses 70 and 72 are coupled to Green and Blue inputs of DAC 50, respectively, 

is while bus 74 is multiplexed with graphics channels 62 from graphics memory 36 and coupled to the Red input of DAC 
50 (described below). Since bus 62 and bus 74 each include four channels, the graphics channels and video channels 
employ 4-way multiplexing. In alternate embodiments, N-way multiplexing can be employed, where N can be a value 
of 2 or greater. 

When video pixels are output from the video memory 46, a row of video pixels is loaded into shift registers (or 

20 serial access memory) included in the video memory from banks A-D. For example, a row can equal 1 024 pixels in a 
horizontal scan line. A block of video pixels is then shifted from the shift registers into an output buffer that stores a 
block of video pixels and which is also included in video memory 46. In the described embodiment, a block of video 
data includes 4 video pixels, one pixel per video channel, where each Bank is coupled to one video channel. The output 
buffer, similar to the output buffer described in graphics memory 36, outputs a single block of pixel data at a time tor 

25 three 32-bit buses, thus totalling 96 bits. In addition, video channels are coupled to the output buffer of video memory 
46 and are controlled by tri-state buffers which either enable a video channel to carry data or disable the video channel 
and prevent data from being output on bus 74. The tri-state buffers of bus 74 are controlled by source selection logic 
48, which is described below. Preferably, one block of video pixels is output from the output buffer, and a new block is 
shifted from the shift registers to the output buffer. Once the shift register has been exhausted, the next row of pixels 

30 is loaded into the shift register from Banks A-D 

Video memory 46 of the described embodiment also preferably includes a random access port coupled to a bus 
76 which is connected to the microprocessor through the system bus 32. The random-access port can be used to 
randomly access the contents of video memory 46. An application that uses such a configuration is teleconferencing, 
in which a video signal depicting, for example, a user's face is sent to the microprocessor and transmitted through a 

35 networking interface to another computer/display screen. A user could thus receive a video signal from a different user 
to display on the computer screen while the user's own picture would be recorded by a video camera near the screen 
and sent to the other user's computer for that user to view on his screen. When outputting video data from the random 
access port of video memory 46, a buffer 47 is used to reduce loading on microprocessor bus 32. 

Video memory 46 is a tri-port video memory, such as MT43C81 28 manufactured by Micron Semiconductor. The 
three ports are the input sequential access port, the output sequential access port, and the random access port. In 
alternate embodiments, other types of video memory can be used. For example, a dual port video memory can be 
used which includes one sequential access port and one random access port. The sequential access port can be used 
for outputting the video pixels to the DAC 50, and the random access port can be used both as an input port for video 
pixels from decoder/sealer 44 and as an output port to send video data to the microprocessor and over a network for 

45 teleconferencing. The dual port video memory is typically cheaper than the tri-port video memory, but rt is slower due 
to the shared use of the random access port as an input and an output. 

Source selection logic 48 is used to select when graphics pixel data and video pixel data are to be output to the 
DAC 50 and displayed on the display screen. The source selection logic monitors pixels codes that are caused to be 
output of window-type memory 38 on bus 61 by graphics adapter chip 34. The source selection logic receives the pixel 

so codes via* 16-bit bus 61 in groups of four, where each pixel code identifies a graphics pixel or a video pixel. The pixel 
codes instruct the source selection logic to turn outputs of the graphics and video memories on or off. The source 
selection logic sends enable or disable signals on bus 45 to the tri-state buffers at the output buffer of bank 58 of the 
graphics memory 36, and sends similar signals on bus 49 to the tn-state buffers of bank 60 of graphics memory 36. * 
Some or all of the tri-state buffers are enabled when the window-type memory indicates which graphics channels should 

55 output graphics pixels, and the tri-state buffers which are not selected to output pixels are left in a high-impedance 
state. Similarly, the pixel codes instruct the source selection logic to send enable or disable signals on bus 51 to the 
tri-state buffers of bus 74 at the output buffer of video memory 46 Tri-state buffers are enabled for video channels 
which are indicated to output video pixels. 
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EA = /(WTAO & WTA1 & WTA2 & WTA3) 

EB = /(WTBO & WTB1 & WTB2 & WTB3) 
EC = /(WTCO & WTC1 & WTC2 & WTC3) 
ED = /(WTDO & WTD1 & WTD2 & WTD3) 

mo J^ e Jl E . A ' EB EC ' and E ° ** ' he < ac,jv<How > si 9" als »** enable or disable the trnstate buffers of the video 
memory, and, for example, WTA[0:3J are the four bits from w,ndow type memory forming a pixel coZr indicates^ 

7TZ f a in r entnese8 ) tne *«*- I the foJbits JSC 

of iMhen a v,deo p,xe. .s ,nd,caled. The EA signal is thus sen. as an enable (taw) signal to enable £ 

or the correspond^ output video channel of bus 74 of video memo* 46. If any of the bits of the pUel coS are low 

ISZ^IS^T " °' hef4 ' b,,P ^ COdeS - d - b - 61 — b,eord,sab,e,heap P ropna,e 
Source selection logic 48 provides the following signals on bus 45 to bank 58 of graphics memory 36: 



BO_EA = 80_GRE0 + (WTAO & WTA1 & WTA2 & WTA3) 
30 BO_EB = BO.GREO + (WTBO & WTB1 & WTB2 & WTB3) 

BO_EC = B0_GRE0 + (WTCO & WTC1 & WTC2 & WTC3) 

BO_ED = B0_GRE0 + (WTDO & WTD1 4 WTD2 & WTD3) 
The following signals are provided on bus 49 to bank 60 of graphics memory 36: 
B1_EA = B0_GRE1 + (WTAO & WTA1 & WTA2 & WTA3) 
B1_EB = B0_GRE1 + (WTBO & WTB1 & WTB2 & WTB3) 
B1_EC = B0.GRE1 + (WTCO & WTC1 & WTC2 & WTC3) 
so • B1.ED = B0J3RE1 + (WTDO & WTD1 & WTD2 & WTD3) 

B^S£^Jl!i£^''^^ an * m Si9na,S that enab,e 0r disaWe ,n ° , "- 8,a,e b "««« on bank 53 
IM^Li?£ d S '* a,S tKm 9,aphCS Chip 34 10 enabl « ^ 58 or bank 60, *nd WTA-D 
£3] are the four brts forming a P *e. code, if the four bits for a channel are not all high, and the BO GR Ex signal I 
ss h'9h.thenag« P h.cs pK e l <pix^ te^teTtoSle 
the correspond«g tn-state buffer and graph.cs channel of the indicated bank of graphics memory 36*f a7of the b t 
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Source selection logic 48 also sends a frame grabber enable signal on bus 92 to frame grabber controller 52 on 
bus 92 lo signal the frame grabber controller to begin sequencing video pixels out of video memory 46. The frame 
grabber enable signal is output from the source selection logic when the source selection logic receives a pixel code 
of 15 (all 4 high bits), indicating a video pixel, on any of the four channels output on bus 61 from window-type memory 

s 38. Source selection logic 48 also receives two signals from the frame grabber controller on bus 92 which indicate if 
a display update cycle has occurred and if, so, allow the frame grabber controller to control the video memory's tri- 
state buffers for that cycle (described below). 

In an alternate embodiment, multiplexing logic can be used to select specific graphics and video channels instead 
of enabling or disabling memory outputs, as is well known to those skilled in the art. 

io Digital-to-analog converter (DAC) 50 is coupled to several input channels for the purpose of converting input digital 

data to output analog signals used by the display screen to display pixels. In the described embodiment, DAC 50 is a 
Brooktree BT463 DAC which includes an R input, a G input, a B input, and a WT input. DAC 50 preferably has two 
modes to display graphics pixels: a true color, 24-bit display mode, and a ■pseudo-color* mode. The pseudo color 
mode is an 8-bit display mode which uses a programmable color "palette 1 stored in the DAC to display "pseudo" 24-bit 

is colors for graphics pixels. The color palette is a hardware (software-programmable) look-up table that matches 24-bit 
colors with the 8-bit graphics values that are input to the DAC in pseudo color mode. For example, an 8-bit graphics 
pixel value between 0-255 that is input to DAC 50 is referenced on the color palette, which stores a corresponding 
24-bit value for each 8-bit value. The corresponding 24-bit vaiue is used as the color of the 8-bit pixel. The 24-bit values 
in the color palette are previously chosen to correspond to specific 8-bit values. Typically, different color palettes are 

20 used for different application programs executed by microprocessor 31 (or another connected microprocessor); for 
example, the active application program provides an individual color palette from which all displayed 6-bit pixels are 
referenced When the active application program is changed, a new color palette with different colors can be loaded 
and used by DAC 50. Pseudo color mode has the advantage that the graphics pixels require less memory space and 
processing time, with the drawback of less realistic pixel colors. 

25 The mode of DAC 50 is selected for each pixel by the pixel codes from window-type memory 38. Graphics adapter 

chip 34 causes window -type memory 38 to send pixel codes to DAC 50. If the pixel code from the window-type memory 
is a value between 0-14, indicating a graphics pixel, the bits of the pixel code can be used to select either true color 
(24-bit) mode or pseudo color (8 bit) mode. For example, if the first bit of the pixel code is 0, one mode is indicated, 
and if the first bit is 1, the other mode is indicated. This graphics pixel code information can also be used to select 

30 different palettes for different graphics pixels in pseudo color mode, as is well-known to those skilled in the art 

DAC 50 uses all three inputs R, G, and B for video pixels. A video pixel is separated into three 8-bit portions, where 
each portion is input to one of the RGB inputs. A video pixel is combined into 24 bits in DAC 50. The R input preferably 
receives the first 8 bits, the G input the middle 8 bits, and the B input the final 8 bits of a video pixel. Each RGB input 
receives 4 video pixels at once in the described embodiment, each video pixel being sent on an 8-bit video channel. 

35 The 32-bit buses shown in Figure 2 each represent four 8-bit video channels. 

The R input of DAC 50 is a special case. Since the graphics pixels from graphics memory 36 are 8-bits (in the 
described embodiment), only the R input to the DAC 50 is used for displaying graphics pixels in the described embod- 
iment. Since both graphics data and video data use the R input, the graphics channels of bus 62 and the video channels, 
of bus 74 coupled to the R input are multiplexed. Either a graphics pixel or a video pixel is sent to the R input of the 

40 DAC on each channel. In other embodiments, different or additional inputs to DAC 50 can be similarly multiplexed. 

As shown in Figure 2a, each 8-bit graphics channel 76 of bus 62 is connected to a corresponding 8-bit video 
channel 78 of bus 74. Output channels 80 of bus 82 are connected from the junction of the graphics and video channels 
to the DAC 50. A block of output pixels includes the pixels on the four output channels 80. As shown in Figure 2b, the 
connection of each 8-bit channel 76 and 78 includes a similar connection between each graphics bit line 84 in channel 

45 76 with each video bit line 86 in channel 78. An output bit line 88 is coupled to each graphics and video bit line connection . 
Since either graphics data or video data is displayed on the screen, either a graphics channel 76 or a connected 
(corresponding) video channel 78 is "selected" to output data (i.e., allowed to send its data) on the connected output 
channel 80. The method of sending graphics and video pixels and selecting appropriate channels is described below. 
Referencing Figure 2, frame grabber controller 52 is coupled to the microprocessor of the computer system by 

so system bits 32 •Frame grabber controller can be implemented with an ASIC controller or with a different architecture; 
for example, a Xilinx 4000-series field programmable gate array (FPGA) can be used. The frame grabber controller 
controls the sequencing of input video data and output video data to and from video memory 46. Bus 90, including 
address and control lines, s used tor general controf of th'e video memory, including refresh, clocking video input, video 
output, and microprocessor access, as is well known to those skilled in the art. Frame grabber controller includes 

55 dummy pixel logic 53 for the insertion of dummy pixels in the video memory, as described below. 

Frame grabber controller 52 also controls buffer 47 via line 91 . Line 91 controls when video data from the random 
access port of video memory is sent on the system bus to the microprocessor to be sent out on network wires, such 
as in teleconferencing applications. 
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Frame grabber controller 52 also receives signals from and sends signals to source selection loaic 4fi nn h„c oo 

^JSS^^EL 98 ST* '°, Send 8 diSP,3y UPd3,e Si9na ' ' rom ,rame 9 ' abbef "»* 53 to 
!Xo mpmnl^ ^ ^ ^ P V Upda,e S ' 9na ' a " OWS ,hc ,rame 9 rabber controller .o con.rol the serai outputs of 
TawZiZfl* 3 * T 16 T ° f " b ' ankin9 " A diSP ' ay Upda,e c V c,e ««■ -t,en a dispay dev.ce such 
tln?I,K ! T"' ™ St S,0p d,Splayin9 ** 80 ,hat ,he 863(1 '™ can be reset from the right edoe oMhe 

IT.T (Ve,raCe ' ) * ,h8 b " innin9 °' ,he ™« ««»• frame graTbeTSI £ 
knows when the display update cycle occurs and so controls the video memo* tri-state buffers to load datable 

t£XT, h oT? mem0fy dUri09 ,he disp ' ay upda,e <* c,e ' as is "*» *™n to those sk^'The art The 

g.. low) or the frame grabber controller (e.g., high)). When the output device is on a display update cvcle thTfl™, 

SET 00 ? 0 is I 8elected ^ ,hird ,ine °' bus 92 h used ,o ,ra " sm « a sariai 

dummy pixe , value to determine how many dummy pixete are to be Lrted in ES^^^bSE te 
.rstvxieo pixel on a delayed horizons, scan line. The insertion of dummy pixels are described* oe a w^ 

respect to Figures 3a and 3b, and a preferred implementation of dummy pixel logic 53 is shown Z Ftau re 4 Dmnw 
P*el tog« * shown demented on the same integrated circuit chip aslame gibber conlZ 52 n aSematHm" 

g r s= 

S5T ^ 54 A ^ 57 °< V ^ * Pi-* d,spUtmTd?S; n r e oun: 

The display system of Figure 2 operates to display graphics data and video data on a display screen as foltows 
processor 31 sends instructions on system bus 32 to graphics adapter chip 34 to J e a Tc un 
w^ow-type memory 38 which rrtcates the current tocation of the pixels of a video window or '£ SSST 

csTeZ^X3^^^ 8f Ch,S S,0feS ,he 9enera,ed £*» * ^ 3kS g Zh 
5 £3 ™, T k '? readV t0d ' SP,ay Pixels ,he 9faphics ada P»^chip sends signals to graphics memory 
36 to send out the graphics p.xels ,n accordance with the display screen's parameters sue* as refresh rat T°ne 
graph,cs adapter chip continuously sends out graphics data from the graphics Memory 

r^nHinnl 33 " 8 diSpl8y SCr6en Sh ° Win9 vide0 pixels h a video " ir *°« 96 and graphics pixels 97 sur- 

St Z T^Tl 96 r 6,3 00 9,8 diSp,8y SCreen are ^P"** in "onzontaT scan lines t™ let, , 0 

r,ght. For a particular honzontal scan line (or row) of pixels 98, the first pixel 100 on the left edqe of the screen is 

,oltowed b * ,h * " ext P« el 1 °2 ^ «he right, and so on. until the right edge of the screen J eacfTJd ?he 
process then repeats with the next horizontal row of p«els 104 below the horlontalTow just displayed etc 

Graphics memory 36 normally outputs blocks of four graphics pixels at a time to DAC 50 in the described embod 
Z££SP J? me Sel8C,i0 ° ,09iC 48 8nab,es a " ,he «*— • buffers a, hroutuSTg^IS 

2TZ?fJ? dd ^ b,esa,,me,n * te,ebufl ^^^ 

are selected tooutput graphics data (the video memory is stonng .nccming video pLs t^^ 

S^?Tf PiX8 ' S ^ SeqUen,ia " y °" ,h9 dis P ,a ^ ^ Bl ~^s 106 o, toTgraphTcs pTet are 

tT^i ^ ,0 " 9h l un,il ,he desired ^ dar of me video window is reached. A. th.s S the source 
selection log* 48 reads video pixel codes for the video window (rom the screen pixel map in winctow^Pe memor^ 3 

ST? 8 Va ' Ue 01 15 " ^ d8SCfibed ^ sou^setectior, k^52C Z32 

on bus 92 ih m!? Tk 0 * 36 ° UtPUtS 80WB * Se,8C,k5n ^ 48 Si9 " a,s tne grabber crmro jr 2 
nTen^rv L A, T ? ^ ^ * ^ *«< u °™9 blocks of four vkJeo pixete at a time out of video 
^ M ,he , same ,me " tegic 48 enables tri-state buffers on the outputs of video « 

oi r!Th P ! X8 °° V,de ° Channels 78 10 be oW P ut ,rom ,he v'^so memory to the DAC. Using this ptocTss btocfe ' 
ofg ra ph,csp.xelsaresent« 1 ou^u,channels8<)(seeFigure2a)wbenm 

h 9 ? , V ' de ° W ' nd0W 96 38 Sh0W ° 1,1 R9Ufe 33 is a,i 9 ned wim «he edge of a block of graph.es 
data^i e. a d.screte graphs block boundary The left border of the video window is display ed after a b^k Vo6 oHou' 
graphics pixels have been dispfcyed In mis situation, all four graph** channete a^L^^ ^X 
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block of graphics pixels on output channels 80 until the video window is reached, at which time all the graphics channel 
tri-state buffers are disabled and all four tri-state buffers on video memory 46 are enabled to output a block of four 
video pixels on all four video channels 78. At the right edge of the video window (not shown), the source selection logic 
reads a graphics pixel code from window-type memory 38 and. in response, disables the video channels, signals the 

5 frame grabber controller to stop shifting out video pixels from video memory 46. and enables all four graphics channels. 
The same process occurs for each horizontal scan line. 

Figure 3b shows a different situation, in which the left border 108 of the video window ts displayed between a 
graphics block boundary. In this situation, some of the four output channels 80 must be selected to output graphics 
pixels, and. simultaneously, some of the four output channels 80 must be selected to output video pixels. That is, a 

10 block of data on the four output channels 80 must include both graphics pixels and video pixels. In the example of 
Figure 3b, the first two output channels must be graphics channels so that graphics pixels 110 and 112 are displayed, 
and the final two output channels must be video channels so that video pixels 114 and 116 are displayed. 

To permit the video window to be displayed at an arbitrary graphics pixel boundary, video pixels must be output 
on specific video channels. The outputs of a video memory typically function by emptying out a block of all four video 

is pixels (32 bits) in the output buffer of the video memory at once (for each 32 bit bus 70, 72 and 74). A video pixel is 
physically output on a video channel 78 only if the tri-state buffer tor that video channel has been enabled. The next 
block of four video pixels in memory are then loaded into the output buffer of the video memory to be output at the next 
opportunity. This creates a problem when, as shown in Figure 3b, only some of the video pixels need to be output. If 
only the third and fourth tri-state buffers are enabled, the first and second video pixels in the output buffer are lost and 

20 never seen in the video window. This loss of data creates a cropped or "clipped" video window picture. On the other 
hand, if ail four video pixels are output every time video pixels are displayed (no outputs disabled), then the video 
window cannot be arbitrarily aligned on any graphics pixel boundary; the video window must be displayed with horizontal 
alignment restrictions such that, in an N-way multiplexed system, the left border of the video window can only be 
positioned at every Nth horizontal pixel. 

25 A solution to this arbitrary video window alignment problem in accordance with the present invention is to insert a 

number of dummy video pixels ("dummy pixels") in the sequence of outputted video pixels Jo shift the actual video 
pixel data. In the example of Figure 3b, two dummy pixels are inserted before the block of video pixel data. This shifts 
the first and second video pixels of the block into the third and fourth pixel locations (positions) of the block, the former 
third and fourth video pixels are shifted into the first and second positions of the next block of video pixels, and so on. 

30 When the block of video pixels is outputted from the output buffer of the video memory, the first and second video 
channels are disabled and the data at the first and second pixel positions are lost. However, only dummy data is in 
those first and second pixel positions. The third and fourth video channels are enabled, allowing the former first and 
second video pixels to be output and displayed on the screen in their proper sequence. 

The number of dummy video pixels required to place the video window on an arbitrary graphics pixel boundary 

35 without loss of video data is equal to the column number of the left border of the video window modulus the number 
of output channels 80. In the example of Figure 3b, the video window begins at column number 202 (counting from 
the left edge of the screen). There are 4 output channels in a 4-way multiplexed system, so that the number of dummy 
pixels needed is 202 mod 4 (the remainder of 202/4), which equals 2. The microprocessor computes the number of 
dummy pixels required based upon the current position of the video window and stores the number in the frame grabber 

40 controller. Each time the video window is moved or resized, the microprocessor must update the number of dummy 
pixels in the frame grabber controller. The frame grabber controller 52 provides the dummy pixel value (i.e. the number 
of dummy pixels to insert) to the dummy pixel logic 53 (described below), which controls the clocking in of data from 
the decoder/sealer 44 to provide the proper number of dummy video pixels before each horizontal scan line of video 
pixels. Source selection logic 48 uses the pixel codes from window-type memory 38 to disable the proper tri-state 

45 buffers on the outputs to the video memory. 

In the described embodiment, dummy pixels are created and inserted in the video memory by "clocking" identical 
video pixel values into multiple banks of the video memory 46 at the same time according to a clock signal (preferably, 
the video pixels are first clocked into shift registers and then stored into the banks of the video memory from the shift 
registers, as described above). The Banks that are clocked depending on the number of dummy pixels to be inserted 

50 is shown-in Table 1 . 



Table 1 


Number ol Dummy Video Pixels to be Inserted 


Banks clocked 


0 


A 


1 


A, B 


2 


A, B.C 
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Number of Dummy Video Pixels to be Inserted 


Banks clocked 


3 


A, B, C, D 



o?^^ 7 Fi f- * a sing.e vtfeo pixel is ckxked into Banks A. B. and C 

•mo Bank D. Only t£tS2SS^J52|S2 n S T V *° P ' Xe ' "* decod ^i e r is ckxked 
two video pixels in BanksA and B a^dimi^L f ? SeleC,ed ,0 be oulpul on video cnan "els: the other 

- pixe.s are output ,n 5££ & ZSSSSl!" P ^ ° ^ PlXe ' S> ,ha < are lost ^umm 

Dummv obrels for tL nr=I^! P honzon,al 803,1 at the left border of the video window 

two-bit code that is written into 3^ea^S 

by counter 120 on bus 24 betore eS ^aStS?' m « ro P rocess0f31 This dummy pixel value is received 
» that countsafter each pix^cteChlo^mS^ ^ 120 * pre ' 6rat5,y a ^ modul °- 4 <*™ter 

grabber controtler). Counfen^ SZTpSST^r 'ST""* * 
120 to zero when the first valid video oixel of a <~,n . i ' 9031 00 " ne 128 ' clear s counter 

example, generated by a "ipC^^e^ can be, for 

on a scan line and clears FPI (low) after th« first ™" lroHer wnicn se 's F PI bigh before the first video pixel 

output on bus 126 to channel tagic iS ' ° ^ <C) °' ' he C0Un,er 120 is a <"° 

is se?^^ vidS ^.^J^^SS? £ ^ ™ « - 1 * Th. PP, signal 
into video memory 46 is the L (STmoS S " L ^ , * ° f ,he CUrfen ' pbtel bein 9 cto <** 

logic 22 outputs four ckxk ISa^KTcS L DcTk r ^ ^ " 4 °' 36 Cha ™' 

address/contro, bus 90 coup£< to ^^^LT^Z £j 22 ST* T"* ^ h 



i — — >«• own mi nne roi 

Channel logic 22 implements the following logical equations: 

ACLK = !FPI * (C == 0) + FPI 
BCLK = !FPI * (C = 1) + FPI * (C>=1) 
CCLK = !FPI * (C == 2) + FPI * (C>=2) 
DCLK = !FPI • (C = 3) + FPI • (C==3) 



so 



55 



electronic components as is well-known *^S^££ " ' mPlemenled 93,68 and °' her 

boen^rwTaXe^^ 

connected together. A suLe £XZ?S£i 
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is preferably used, in which 5 bits are used for the red portion. 6 bits for the green portion, and 5 bits for the blue portion 
of the signal. Thus, a 20-bit bus 74 includes four video channels of 5 bits per channel. 

DAC 50' preferably selects graphics and video channels internally. Therefore no separate source selection logic 
48 or window-type memory 38 is required in the present embodiment. To select the correct channels. DAC 50* requires 
5 the location of the video window. The microprocessor writes the video window location information to DAC 50'. This 
information can include the coordinates of the opposite comers of the displayed video window DAC 50' knows when 
to switch from graphics channels to video channels and vice versa by using internal components to keep track of the 
displayed pixels. A counter can be used to count the column at which an inputted pixel is being displayed, and another 
counter is used to similarly count the row of the displayed pixel. Four registers of the DAC can be used to store the 
10 location of the video window, including the column of the upper left corner of the video window, the row of the upper 
left corner, the column of the lower right corner of the video window, and the row of the tower right corner. The DAC 
can compare the current counter values of the column and row of a displayed pixel with the values of the borders of 
the video window stored in the registers to determine if graphics pixels or video pixels should be selected and displayed. 
DAC 50' then enables or disables the proper video and graphics channels according to internal components, as is well- 
's known to those skilled in art. Using the video memory of the previously -described embodiment. DAC 50' can display 
a 5 1 2 x 51 2 pixel video window. 

DAC 50' also preferably includes a small first in first out (FIFO) queue. Video data can be buffered or stored in this 
FIFO until it is displayed. The FIFO thus eliminates the need for inserting dummy pixels on the video channels by 
dummy pixel logic 53, since the video data can be stored independently of displayed graphics pixels. The other com- 
20 ponents of display system 30' operate similarly to the components of display system 30. 

By using a separate video memory for video data in the present invention instead of sharing memory for graphics 
and video data, the graphics memory bandwidth can be much larger. A much higher data transfer rate can thus be 
achieved when displaying graphics pixels using this configuration. The use of - N' graphics channels and video channels 
iilowo data to be displayed at a rate fast enough to make full use of the DAC's high speed and avoid slowing down 
25 graphics intensive operations. Finally, the use of dummy video pixels permits the video window to be located on any 
puoi column of the screen (i.e., single pixel resolution) and not be constrained to a discrete boundary after a block of 
n pfrtphes pixels in an n-way multiplexed system. 

Although only one embodiment of the present invention has been described, it should be understood that the 
pro^pnt invention may be embodied in many other specific forms without departing from the spirit or scope of the 
30 m yen on Particularly, the source selection logic of the present invention can be implemented in many different ways 
to pcrtorm the function of selecting channels from graphics and video memories to display a video window with greater 
cut* bandwidth. 

The display system of the present invention has been described as applied to various specific implementations. 
However it should be appreciated that the described display system can be applied to a wide variety of applications. 

35 in some systems, for example, it may be possible to output specific pixels from video memory and align the video 
wndow wmout inserting dummy video pixels. In other implementations, it may be desirable to add a third source of 
displayed pixels such that three different buses are multiplexed before being input to the DAC. Therefore, the present 
examples and embodiments are to be considered as illustrative and not restrictive, and the invention is not to be limited 
to the details given herein, but that modifications and/or additions to the embodiments may be made within the scope 

40 of the invention 



Claims 

45 1. a method for simultaneously displaying graphics data and video data on a display screen of a computer system 
having graphics memory and video memory arranged to store image information to be displayed on the display 
screen, the display screen displaying a multiplicity of pixels, wherein the graphics memory and the video memory 
are each arranged to sequentially transmit blocks of pixel data to the display screen on output channels, and 
wherein each btock of pixel data includes data for a plurality of screen pixels that is transmitted simultaneously, 

so the method comprising the steps of: 

storing graphics data received from a graphics source in graphics memory; 
storing video data received from a video source in video memory; 

selectively outputting graphics data for a block of pixels simultaneously from the graphics memory on a number 
55 of graphics channels when only graphics data is to be transmitted to the screen on output channels connected 

to said graphics channels; 

selectively outputting video data for a block of pixels simultaneously from the video memory on a number of 
video channels corresponding to said number of graphics channels when only video data is to be transmitted 
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J^t^ * « a and , video date «e to be transmitted to the screen s.mu.taneously in a single block 
to ^ansmitll P k a ^ 6,S ' C3US " 9 the OU,put cnannels ,h * « '"'ended car^ graph cs^a 

A method as recited in claim 2 wherein said outputting graphics data from said aranhir* mom™, 

sssrsisi™ 5 " — sssszrsss 

" ^ Pr6Cedblg Wherein nUmbef °' 9WS Channels - — of video 

9 ' mtTnif ,„ a L reCit8d in h any 7 eCedin9 Cteim ^ erein "*» 8,8 P <* selective^ causing the output channels that are 

to dispSay v^deo S P V 9faPh,CS d3ta ^ WhiCh Pb<els 0,1 said scree " ™ ^tended 

1 0. A method as recited in any preceding claim further comprising a step of receivino anakv, , 

A method as recited in claim 1 0 further comprising a step of scaling said digital video data to a predetermined size. 
1 2 ' JT£lr 1 ** d " ^ PreCSdin9 C>a,m Whefein " M Vide ° ^ ,ranSmtt,e<1 to « id is 24-bl tnJ e color 

13. An apparatus for displaying a vrdeo w,ndow on a d.sptay screen of a computer system, compnsing: 
c^iTa^ 

a video memory having a set of output video channels suitable tor simultaneously transmitting video data for 
a pluralty of screen p«e.s. where,n each video channel . coupted to a corres^ing fSSS Z 
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form a pair of channels and wherein an output channel is coupled to each of said pairs of graphics channels 
and video channels; 

a selection element for selectively causing data from said graphics memory and said video memory to pass 
on each of said output channels such that the output channels may transmit a block of pixel data that simul- 
s taneously includes both graphics data and video data divided on a discrete pixel basis; and 

a converter element for converting data on said output channels into a form suitable for driving the display 
screen of the computer system. 

14. An apparatus as recited in claim 1 3 wherein said graphics memory comprises a VRAM chip storing graphics data 
io from a graphics chip. 

1 5. An apparatus as recited in claim 1 3 or claim 14 wherein said video memory comprises a VRAM chip storing video 
data received from a video source. 

is 1 6. An apparatus as recited in any one of claims 1 3 to 1 5 wherein said selection element includes window-type memory 
having a memory map of a location of a video window displayed on a display screen of a computer system. 

17. An apparatus as recited in claim 16 wherein said selection etement includes source selection logic operative to 
read said memory map in said window-type memory and select said data on said output channels according to 

20 said window-type memory. 

18. An apparatus as recited in claim 17 wherein said source selection logic is coupled to said graphics memory and 
said video memory and is operative to enable output buffers of said graphics memory and said video memory to 
select said data on said output channels. 

25 

19. An apparatus as recited in any one of claims 1 3 to 18 wherein said converter element includes a digital to analog 
converter (OAC) coupled to said video memory and operative to convert a digital video signal from said video 
memory to an analog signal capable of being displayed on said display screen. 

30 20. An apparatus as recited in any one of claims 1 3 to 1 9 wherein said set of graphics channels and said set of video 
channels each include four channels. 

21. An apparatus as recited in any one of claims 13 to 20 wherein said video memory stores a number of dummy 
pixels positioned before said video data in said video memory such that said dummy pixels are output on video 

35 channels that are not selected to output to said converter element. 

22. An apparatus as recited in any preceding claim further comprising a frame grabber controller copuled to said video 
memory and said selection element for controlling the output of video data from said video memory 

23. A computer system comprising: 

a processor, 

a memory element coupled to said processor; 

a "graphics adapter coupled to said processor for receiving commands from said processor and outputtmg 
45 graphics data according to the commands; 

a graphics memory coupled to said graphics adapter for storing said graphics data and having a set of output 
graphics channels suitable for simultaneously transmitting said graphics data for a plurality of screen pixels; 
a video converter for converting a video signal from a video source to video data suitable for storage in video 
memory; * 

so a videO memory coupled to a said video converter for storing said video data and having a set of output video 

channels suitable for simultaneously transmitting video data for a plurality of screen pixels, wherein each video 
channel is coupled to a corresponding graphics channel to form a pair of channels and wherein an output 
channel is coupled to each of said pairs of graphics channels and video channels; 

a selection element for selectively causing data from said graphics channels and said video channels to pass 
55 on each of said output channels such that the output channels may transmit a block of pixel data that simul- 

taneously includes both graphics data and video data divided on a discrete pixel basis; and 
a converter element for converting data on said output channels into a form suitable for displaying said data; 
and 
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(54) Method and apparatus for simultaneously displaying graphics and video data on a computer 
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(57) A method and apparatus for displaying graph- 
ics data and video data, such as a video window, on a 
computer display. A graphics adapter chip stores graph- 
ics pixel data in a graphics memory, and a video source 
stores video pixel data in a video memory. The graphics 
and video memories sequentially output blocks of pixel 
data to the display screen on output channels. Graphics 
data is selectively outputted on a number of graphics 
channels and video data is selectively outputted on the 
same number of video channels. The video channels 
are multiplexed with the graphics channels to form the 



output channels and either graphics data or video data 
can be output to the display on each output channel. A 
number of dummy video pixel values can be inserted 
before video data in the video memory to align video 
pixels between blocks of graphics data on the display 
screen. In one embodiment, a source selection element 
selects graphics and video channels by reading a win- 
dow-type memory to determine which pixels on the 
screen are intended to display graphics data and which 
pixels are intended to display video data. The data on 
the output channels is converted to a form suitable for 
driving the display screen of the computer system 
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